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ABSTRACT 


A  method  for  detraining  the  optimal  or  near-optimal 
search  path  for  the  wake  of  a  moving  target  when  the  search¬ 
er  *s  aotion  is  constrained  is  presented.  The  problem  uses  a 
Harkov  action  model  in  discrete  time  and  space  for  the 
target  and  assumes  that  the  searchar  is  constrained  to  move 
only  from  the  currently  occupied  call  j  to  a  specified  set 
of  "neighbor  cells",  1(1).  First,  a  discussion  of  the 
complexity  of  the  problem  is  presented.  Hext ,  an  extension 
of  T.J.  Stewart's  constrained  searchar  algorithm  is  given. 
Stewart's  algorithm  uses  S.S.  Brown's  unconstrained  searcher 
algorithm  to  calculate  bounds  on  the  probability  cf  non¬ 
detection.  An  extension  of  Brown's  algorithm  to  allow  the 
use  of  a  wake  detector  is  also  given.  Several  alternatives 
to  both  algorithms  are  offered  and  compared.  Finally,  some 
further  extensions  to  the  aloorithms  are  suggested. 
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i.  nnoDgmos 

1.  THE  PHOBLEH 

The  problem  considered  here  i3  the  search  for  the  wake 
of  a  sowing  target  in  discrete  tine  and  space.  The  target  is 
assueed  to  move  through  a  finite  number  cf  cells  according 
to  a  known  Harkov  process .  The  goal  is  to  maximize  the 
probability  of  detection  by  some  specified  time,  t.  The 
searcher  is  assumed  to  be  partially  constrained  in  his 
lotion  through  the  search  area,  being  able  to  move,  ir.  one 
tiie  period,  from  one  cell  to  a  limited  number  of  cells  in 
close  proximity.  The  searcher  is  also  assumed  to  have  an  'n 
time  period  wake  detector.*  The  detector  is  capable  of 
detecting  wakes  left  in  a  cell  by  the  target  up  tc  n  *-iae 
periods  earlier. 

The  approach  taken  to  solve  the  problem  was  *o  extend 
the  method  of  T. J.  Stewart,  [Baf.  1]  and  s.S.  3rown, 
f  Blf  •  2  }•  Stewart  addressed  searcher  employment  for  *hree 
cases:  where  the  searcher's  effort  was  infinitely  divisible 
among  all  cells,  only  partially  divisible,  or  totally  indi¬ 
visible.  The  three  cases  corresponi  to  the  situation  where: 
searcher  effort  could  be  divided  among  all  the  possible 


cells  during  each  tiie  period,  searcher  effort  could  cover 
soie  of  the  cells  during  each  time  period,  and  searcher 
effort  could  only  cover  one  cell  during  each  time  period. 
Stewart  presented  algorithms  for  finding  optimal  or  near- 
optimal  solutions  for  the  first  and  third  cases  and 
suggested  possible  aethods  for  solving  the  second  case. 
This  thesis  generalizes  the  third  case  to  allow  for  wake 
detection;  i.e.,  the  target  can  be  detected  at  each  time 
period  in  each  of  several  cells  through  which  the  target  has 
previously  passed  in  the  last  n  tiie  periods. 


A  major  difficulty  of  the  algorithms  of  Stwart  and  Brown 
is  that  they  are  not  guaranteed  to  produce  the  optimal  solu¬ 
tion  for  reasons  which  will  be  discussed  later.  This 
failure  to  always  find  optisal  solutions  for  tha  indivisable 
effort  case  suggests  that  this  problem  might  be  fundamen¬ 
tally  intractable. 

One  of  the  recent  advances  in  computer  science  is  the 
idea  of  algorithmic  complexity  and  NP-  Completeness. 
HP-Completeness  refers  to  the  inherent  intr actablility  or 
difficulty  of  a  problem.  Generally,  NP-Completener 
describes  a  set  of  problems  which  have  been  shown  tc 
solvable  by  an  efficient  algorithm  which  is  run  on  a  nor 
deterministic  Turing  Hachine.  An  efficient  algorithm  is  o 
which  will  solve  a  problem  in  an  amount  of  time  proportiona¬ 
te  a  polynomial  function  of  the  length  of  the  input  needed 
to  describe  the  problem.  Well-known  HP-Complete  problems 
include  traveling  salesman  problems,  the  knapsack  problem, 
and  integer  programming  problems.  In  Appendix  1  a  more 
complete  discussion  is  presented  of  the  complexity  of  the 
search  problem  forming  the  basis  for  this  thesis.  It  is 
suspected  (but  has  not  been  proved)  that  this  search  problem 
is  no  easier  than  HP-Complete  problems  and  may  be  NP-Hard. 
If  so,  then  the  investigation  of  heuristic  or  approximate 
solution  algorithms  is  warranted.  Por  further  information 
on  HP-Completaness  refer  to  [Bef.  3]. 


II.  HI  iLGOBITHgS  2552 


As  mentioned  earlier,  the  algorithms  used  to  solve  the 
search  prcblei  were:  1)  r.J.  Stewart's  Constrained  search 
algorithm  [Ref.  1],  and  2)  Brown' 3  Unconstrained  Search 
algorithm,  [Ref.  2].  The  Constrained  Search  Algorithm 
assumes  the  searcher  is  constrained  in  his  motion  during  the 
search,  i.e.,  the  searcher  can  go  from  his  current  cell  to 
some  subset  of  all  the  other  cells  in  the  grid.  The  uncon¬ 
strained  searcher  algorithm  put  -  no  constraints  on  searcher 
motion  but  does  assume  that  the  first  t  search  cells  are 
fixed  and  tries  to  optimize  the  search  by  choosing  the  cells 
to  search  from  t+1  to  T.  Even  in  the  unconstrained  problem, 
search  is  limited  to  one  cell  per  time  period. 

1.  STEWART'S  ALGORITHM 

1 .  P^initjoa  of  Syabjll 
J  *  set  of  all  cells  in  the  problem 
jeJ  *  a  particular  cell 

I(j)  »  matrix  of  all  cells  in  J  that  the  searcher  can 
reach  from  cell  j  (different  for  each  j  J) 

ji  *  the  cell  to  searched  at  time  i 

{ jO,  jl ,. . .,  jt}  *  a  given  search  plan 

Mtfjt)  *  matrix  of  all  cells  in  J  searchable  at  tie®  t*1 
from  cell  jt  that  have  not  yet  been  considered  in  candi¬ 
date  search  plans 

p  »  probability  of  non-detection  for  the  current  best 
solution  (search  plan) 


St  (1)  *  the  nxn  search  matrix  for  time  period  t  where 

cell  i  is  the  cell  to  be  searched 

1  ]  *  a  colain  vector  of  1's 

2.  Laals 

The  following  algorithm  was  taken  from  [Ref.  1]. 

1.  Set  t*0,  p*1 ;  Select  a  cell  to  be  searched,  jO;  set 
K  (0,10)  *1  (jO)  . 

2.  solve  the  substitute  problei  (discussed  below)  for 
search  over  periods  t+1,  t+2,...,T,  with  the  searcher 
at  jt  prior  to  the  search,  and  with  searcher  location 
in  the  first  period  (i.e.  t+1)  restricted  to  K(t,jt). 
Obtain  thereby  (also  discussed  later)  a  lower  bound  p 
on  the  optimal  probability  of  non- detection  when 
searcher  paths  are  restricted  to  those  passing 
through  (j0,j1,...,jt). 

3.  If  p<p,  goto  step  (6).  Otherwise,  it  is  now  proved 
that  all  continuations  of  the  current  path  are  non- 
optiial,  i.e.  the  arc  from  (t-1,jt-1)  to  (t,jt)  is 
fathomed,  goto  step  (4)  . 

4.  If  t=0,  the  algorithm  terminates  (all  paths  from  10 
are  fathomed)  ;  the  current  best  solution  is  optimal. 
If  t >0,  goto  step  (5). 

5.  Delete  the  current  jt  from  K(t-1,jt-1)  and  set  t=t-l. 
If  K(t,  jt)  is  now  empty,  the  arc  from  (t-1,jt-1)  to 
(t,jt)  is  implicitly  also  fathomed.  Thus  return  to 
step  (4).  otherwise,  return  to  step  (2). 

6.  Select  the  element  of  K(t,jt)  appearing  in  the  solu¬ 
tion  to  the  substitute  problem  and  call  this  jt+1 ; 
set  t«t+1.  If  t<T,  set  K(t,  jt)  *1  ( jt)  and  return  to 
step  (2)  .  If  t*T,  evaluate  the  probability  of  non¬ 
detection  when  the  searcher  path  is  (jO,  jl ,. . . ,  j T|  . 
If  this  probability  is  less  than  £,  then  replace  p  by 


this  value  ana  install  { jO,  jl  ,. . . ,  jT}  as  *he  current 
best  solution.  Return  to  step  (5)  . 

Essentially  the  algorithi  solves  the  partially 
constrained  problem  (unconstrained  after  time  t+1)  at  each 
level  to  obtain  a  lover  bound  on  the  probability  of  non- 
detection  for  any  fully  constrained  searchers  that  have  the 
saae  initial  search  (jO, .. .  *  jt  +  1>  .  The  algorithm  then  trav¬ 
erses  each  branch  whose  lower  bound  is  less  than  the  current 
best  solution  probability.  When  t»r,  the  search  is  now  fully 
constrained;  and  ,  if  its  probability  of  non-detection  p  is 
less  than  p,  then  it  is  a  better  search  plan  and  is  saved. 
When  no  branches  with  probabilities  less  than  the  current 
best  plan  are  left,  the  problea  is  coapleted  and  the  current 
best  plan  is  optiaal. 

Optiaality  is  guaranteed  if  the  lower  bounds 
obtained  froi  the  application  of  Brown's  algorithm  are 
indeed  lower  bounds.  Unfortunately,  due  to  the  nature  of  the 
problea,  (an  integer  programming  problea)  the  results  of 
Brown's  algorithm  are  not  necessarily  lower  bounds.  &  search 
plan  may  exist  whose  "lower  bound",  from  Brown's  algorithm 
is  higher  than  the  current  best  solution  yet  whose  actual 
probability  of  non-detection  for  a  fully  constrained  solu¬ 
tion  is  lower  than  the  current  best  solution.  Thus  the 
branch  containing  the  optiaal  solution  may  be  pruned. 
Therefore,  the  solution  produced  by  Stewart's  algorithm 
using  Brown's  algorithm  as  a  bound  will  not  necessarily  be 
optiaal.  Nevertheless,  the  solution  light  be  close  enough  to 
the  optiaal  for  practical  problems  of  interest. 

3*  I£S 


Stewart's  algorithm  is  essentially  a  depth-first 
search  through  a  tree  of  possible  solutions.  It  uses  Brown's 
algorithm  to  bound  the  branches  and  remove  those  branches 
which  do  not  contain  better  solutions  than  the  current  one. 
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The  depth-first  search  strategy  generates  bounds  at  each 
level  of  the  tree  and  picks  the  be3t  bound  at  that  level  to 
continue  the  bounding  procedure.  In  this  way  it  reaches  a 
fully  constrained  search  in  T  steps  as  it  progresses  down 
through  the  tree,  hfter  reaching  the  first  constrained  solu¬ 
tion  the  algorithm  progresses  bact  up  the  tree  checking 
other  branches  on  the  way  up.  The  algoritha  stops  when  it 
has  progressed  all  the  way  up  to  the  top  of  the  tree  and  has 
no  bounds  which  are  better  then  the  current  best  solution. 

Another  approach  is  to  use  a  best-first  strategy.  In 
this  strategy,  the  best  of  all  the  bounds  currently  calcu¬ 
lated  is  chosen  as  the  branch  to  father  investigate.  After 
the  new  bounds  are  calculated  for  the  one  step  investiga¬ 
tion,  the  best  bound  is  again  chosen  to  investigate.  As  the 
best  bound  is  chosen  it  is  checked  to  see  if  it  aeets  the 
action  constraints.  If  the  solution  does  aeet  the 
constraints  then  the  algoritha  stops  with  the  best  solution. 
Osing  the  best-first  strategy  presented  by  D.  R.  Smith  in 
[Bef.  4],  Stewart's  algoritha  was  revised  and  is  presented 
below: 

1.  Set  t*3,  p*1;  select  jO  to  be  the  initial  search 

cell,  set  K(0,j0)  »l  (  jO)  . 

2.  Solve  the  substitute  problems  (discussed  earlier)  for 
search  over  periods  t+1,t*2, . . ., T  ,  with  searcher  at 
jt  prior  to  the  search,  and  with  searcher  location  in 
the  first  period  (i.  e.  t ♦1 )  restricted  to  K(t,jt). 
Store  the  lower  bound  on  the  optiaal  probability  of 
non-detection  for  each  of  the  elements  of  K(t,jt)  in 
a  priority  queue  based  on  the  lower  bound.  (i.e. 
store  the  search  (jo,. .. , jt*1} ,  the  length  of  the 
constrained  part  of  the  search,  tc*tel,  and  the  lower 
bound  for  each  element  of  K(t,jt)). 

3.  Select  froa  the  priority  queue  the  search  with  the 
smallest  lower  bound  and  set  the  current  search  to 
that  chosen  search.  Set  t*tc,  set  K  (t ,  jt)  »I  ( jt)  . 
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.  Check  the  current  search  to  see  if  it  meats  the  move¬ 
ment  constraints  (i.e.  check  for  feasibility)  .  If 
feasibLe,  then  stop,  the  current  search  is  the  best 
search.  Otherwise,  goto  step  (2). 

Essentially  what  the  best-fir3t  search  of  the  tree 
does  is  generate  bounds  for  each  branch  below  the  root. 
Then  it  picks  the  branch  with  the  best  bound  to  continue  the 
investigation  of  the  tree.  After  bounds  are  generated  for 
each  branch  they  are  saved  on  a  priority  queue  from  which 
the  selection  of  the  best  bound  is  made.  A  priority  queue 
(in  the  impleientation,  a  priority  heap)  is  used  to  minimize 
the  time  and  storage  requiremants  ascessary  to  store  the 
bounds  and  find  the  best  bound.  Then  the  algorithm  picks 
the  branch  with  the  best  bound  to  continue  the  investigation 
of  the  tree.  Once  the  best  bound  is  found,  it  is  checked  to 
see  if  it  conforms  to  the  movement  constraints.  If  it  dees 
conform,  the  algorithm  steps,  the  optimal  solution  has  been 
found.  otheewisa,  tha  branches  emanating  from  the  branch 
under  investigation  are  bounded  and  the  algorithm  repeats. 

D.E.  Smith,  in  [Ref.  4]#  argued  that  the  best-first 
search  of  most  classes  of  random  trees  has  a  strictly 
smaller  expected  time  and  space  complexity.  Therefore,  it 
was  decided  to  compare  the  best-first  and  depth-first  tree 
search  algorithms  for  both  use  of  computer  time  and  opti¬ 
mality  of  results.  The  best-first  search,  however,  is  also 
plagued  by  the  possible  non -optimality  of  Brown's  aloorithm. 

B.  B BOW'S  ALGORITHM 

To  generate  a  lower  bound  on  the  constrained  search 
given  that  the  search  during  tine  periods  1,...,t  is  fixed, 
an  algorithm  presented  by  S.S.  Brown  in  (Ref.  2]  was  used. 

The  target  position  distribution  was  generated  using  an 
initial  probability  density  of  target  location  Po  and  a 
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v: 


Harkowian  aotion  model.  Po,  the  target  initial  distribu¬ 
tion,  is  a  rector  with  dimension  equal  to  the  number  of 
cells  in  the  spatial  grid.  Harkowian  motion  is  described  by 
a  transition  matrix  T  that  contains  the  probability  of 
■owing  to  cell  j  giwen  that  the  target  was  in  cell  i.  After 
one  ti«e  period,  the  new  target  location  density  is  Po*T. 

After  two  time  periods  it  becomes  Po«T2,  and  after  n  mores, 

it  becomes  Po«Tn.  To  implement  search  in  the  model,  a 
search  matrix  St(i)  for  time  period  t  was  used  in  the  form 
of  a  diagonal  matrix  with  the  ith  diagonal  element  giwen  by 
the  probability  of  a  missed  detection,  and  the  other  diag¬ 
onal  elements  egual  to  unity.  Therefore  the  rector  Po»s1  (1) 
contains  the  probabilities  that  the  target  is  in  each  of  the 
cells  and  remains  undetected  after  a  one  time-unit  search  in 
cell  1.  Se  refer  to  this  rector  as  "the  defectire  target 
location  mass  at  time  period  1".  Figure  2.1  illustrates  an 
example  search  problem.  Figure  2.2  illustrates  a  sample 

calculation  of  Po*S1(1).  A  four  time-unit  search  in  cells 

1,  2,  4,  and  3  would  yield  a  defectire  target  location  mass, 
Pt(i)  giren  by  : 

Pt  (i)  »Po*S1(1)  •r«S2(2)  S3  (4)  *T*S4  (3)  (2.1) 

The  final  probability  of  non-detection  pnd  for  the  search  is 
giwen  by: 


Pnd*Pt  (i)  *1]  «.  0.612 


(2.2) 
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Figure  2.1  Example  Search  Problem. 

1-  J2fi££aUi2&  °£  Sl»b2is 

Sj  *  The  search  plan  chosen  after  j  iterations  of  Brown's 
algorithm 

Sj(t)  *  The  cell  to  be  searched  in  time  period  t  in  the 
search  plan  Sj 

Pnd(Sj)  *  The  final  probability  of  non-detection  associ¬ 
ated  with  the  search  plan  Sj 
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2.  i°Si£ 

1.  Given  an  initial  guess  So  at  a  search  plan,  and  given 
a  solution  tolerance  e>0,  set  t*1,  j*1,  and  S1*So. 

2.  Choose  Sj(t)  to  minimize  pnd  (Sj)  ,  (S j  (i)  is  fixed  in 
this  minimization  for  i#t.)  The  minimization  is  done 
by  calculating  Pnd(Sj)  for  all  possible  choices  of 
Sj(t)  and  choosing  the  S j  (t)  which  has  the  smallest 
Pnd(Sj)  . 

3.  If  t»T,  goto  step  u.  Otherwise,  increment  t  and  goto 
step  2. 

4.  If  Prd(S j-1) -Pnd(Sj)  <e,  stop.  Pnd(Sj)  is  the  desired 
bound.  Otherwise,  increment  j,  set  t*1,  set  Sj=Sj-1, 
and  goto  step  2. 

Brown's  algorithm  is  an  iterative  improvement  algo¬ 
rithm,  where  at  each  time  step  t  the  cell  which  minimizes 
Pnd  is  chosen,  given  that  the  rest  of  the  search  before  and 
after  t  is  unchanged.  When  the  Pnd  for  Sj  is  within  e  of  the 
Pnd  for  sj-1,  the  algorithm  is  terminated  and  search  Sj  is 
used . 

Brownes  algorithm  in  the  totally  divisible  case, 
where  at  each  time  period  t  the  solution  to  the  stationary 
search  problem  is  found  holding  the  searches  for  time 
periods  before  and  after  t  fixed,  will  converge  to  the 
optiaal  solution  as. proved  in  [Ref.  2].  However,  because 
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the  implementation  here  only  allows  search  in  one  cell 
during  each  tiae  period  the  solution  space  becomes  discon¬ 
tinuous  and  thus  non-convex.  Therefore,  the  algorithm  is  not 

guaranteed  to  converge  to  an  optimal  solution. 

3.  Alternates  s 

Brown’s  algorithm  can  be  considered  to  find  the 
local  optimal  solution  given  a  starting  solution,  so. 

Therefore,  the  total  solution  space  is  partitioned  by 

Brown’s  algorithm  into  those  starting  solutions  which  result 
in  the  optimal  solution  (the  global  optimum)  and  these 
starting  solutions  which  result  in  non-optimal  solutions 
(local  but  not  global  optimums.)  Based  on  this  partitioning 
idea  several  alternatives  are  available. 

The  first  is  to  choose  a  good  starting  solution.  If 
the  optimal  solution  were  used  as  the  starting  solution. 
Brown’s  algorithm  would  always  arrive  at  the  optimal  solu¬ 
tion.  However,  the  optimal  solution  is  not  fcnown,  otherwise 
Brown’s  algorithm  would  be  unnecessary.  Two  approaches  were 
used  to  guess  a  good  starting  solution:  1)  the  myopic  solu¬ 
tion,  So (t)  is  chosen  to  give  the  most  improvement  to 
Pnd(So);  and  2)  a  random  solution,  a  random  number  generator 
is  used  to  generate  random  starting  solutions. 

As  mentioned  in  [Ref.  2],  if  a  zero  solution  is  used 
to  start  Brown’s  algorithm  then  the  myopic  solution  will 
result  after  the  first  iteration.  The  myopic  solution  seems 
lilce  a  reasonable  choice  to  start  the  algorithm.  On  the 
other  hand,  there  might  be  some  negative  correlation  between 
the  optimal  solution  and  the  myopic  solution,  i.e.  the 
myopic  solution  may  lie  in  another  partion  which  does  not 
lead  to  the  optimal  solution.  Therefore  the  random  starting 
solution  was  also  considered  as  a  means  to  gat  around  any 
possible  negative  correlation.  Since  the  random  solution  has 
a  finite  probability  of  choosing  the  optimal  solution  it  may 
have  a  better  chance  of  starting  in  the  right  partition. 


Another  approach  used  was  to  restart  Brown's  algo¬ 
rithm  any  tiae  a  change  was  aada  to  the  current  solution. 
The  revised  algorithm  is  presented  below: 

1.  Given  an  initial  guess  So  at  a  search  plan  set  t*1, 
j*1,  and  SI* So. 

2.  Choose  S 1  (t)  to  minimize  Pnd(Sj)  ,  (SI  (i)  is  fixed  in 
this  minimization  for  i*t.)  rha  minimization  is  dene 
by  calculating  Pnd  (SI)  for  all  possible  choices  of 
SI  (t)  and  choosing  the  S1(ti  which  has  the  smallest 
Pnd  (SI)  . 

3.  If  S1(t)#So(t)  then  set  So(t|*S1(t)  and  goto  step  1. 

4.  If  t*T,  g^oto  step  5.  otherwise,  increment  t  and  goto 
step  2. 

5.  Stop.  Pnd  (SI)  is  the  desired  bound. 

This  variation  of  Brown's  algorithm  takes  an  initial 
solution  and  starts  at  the  first  tima  period  checking  for 
local  optimality  for  that  time  period.  If  the  choice  of  cell 
to  be  searched  at  the  current  tiae  period  is  locally  optimal 
for  that  tiae  period  th9n  the  algorithm  goes  on  to  the  next 
tiae  period,  otherwise,  the  algorithm  inserts  the  new  search 
cell  and  starts  back  at  the  first  tiae  period.  When  the 
algorithm  goes  all  the  way  through  the  solution  without 
changes  it  stops.  This  approach  may  repartition  the  solu¬ 
tion  space  increasing  the  size  of  the  partition  which  leads 
to  the  optimal  solution. 

Another  approach  which  was  not  used  is  to  run  the 
algorithm  several  times  with  different  starting  solutions 
So.  Then  the  lower  bound  can  be  taken  as  the  minimum  of  the 
locally  optimal  solutions  returned  by  che  algorithm.  Also, 
the  lover  bound  can  be  estimated  by 


est*(P95»P5-P32.  52)  /  (P95+P5-2«P32.5)  . 


(2.3) 
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P5,  P95  and  P32.5  are  the  5TH,  95TH  and  32.5TH  percentile 

values.  This  estimate  is  based  on  the  idea  that,  as  the 
number  of  independent  solutions  produced  by  a  given  algo¬ 
rithm  for  a  given  problem  increase,  the  solution  values 
converge  to  a  ieibull  distribution  where  the  optimal  lower 
bound  is  the  location  parameter.  This  approach  was  not  used 
because  it  required  running  Brown’s  algorithm  two  or  more 
times  to  calculate  each  bound  and  it  was  felt  that  the  addi¬ 
tional  computer  time  would  not  improve  the  bounding  process 
significantly. 

A  final  approach  which  also  was  not  investigated,  is 
to  locally  optimize  the  choice  of  cells  over  2,  3  or  more 

time  periods  in  the  Brown  algorithm.  This  again  might 
increase  the  size  of  the  partition  which  leads  to  the 
optimal  solution. 
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1.  B1CK6B00HD 

Is  mentioned  earlier,  this  thesis  is  an  attempt  to 
extend  existing  optimal  search  theory  techniques  to  the 
problem  of  wake  detection.  Stewart* s  and  Brown's  algo¬ 
rithms,  as  presented  in  the  last  chapter,  indicate  one 
method  for  solving  the  constrained  searcher  problem.  The 
next  question  is;  "How  does  one  extend  the  algorithms  to 
handle  the  possibility  of  wake  detection?" 

Stewart's  algorithm  does  no  actual  calculation  of  the 
probability  of  non-detection,  it  uses  Brown's  algorithm  for 
the  calculation  of  bounds.  Therefore  Brown's  algorithm  is 
the  one  that  needs  to  be  altered  to  allow  for  use  of  a  wake 
detector.  To  extend  the  algorithm  we  proceed  as  follows: 

B.  DEPI1ITIOB  OP  STHBOLS 

Po  *  initial  target  probability  distribution  (i.e. ,  the 
probability  that  the  target  is  in  any  cell  i  at  the  start 
of  the  problem.) 

St  (i)  *  an  nxn  matrix  which  reduces  the  defective  prob¬ 
ability  mass  of  the  target  by  1-P(d)  in  cell  i  searched 
at  time  t.  The  defective  probability  mass  of  the  other 
cells  remains  unchanged. 

T  *  a  nxn  Harkov  transition  latrix  which  contains  the 
probability  that  a  target  in  cell  i  at  time  period  t  will 
transition  to  call  j  at  time  period  tel. 

1]  *  a  nxl  column  vector  of  1»s. 
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C.  LOGIC 


What  needs  to  be  extended  is  the  model  under  which  the 
non-detection  probability  is  calculated.  is  shown  earlier, 
this  calculation  for  a  non-wake  detector  in  a  u  time  unit 
search  is 


Pnd*Po  «S1  «T«S  2*I*S  3«T»S4«  1  ].  (3.1) 

It  is  now  proposed  to  allow  the  searcher  to  carry  an 
•n-tiie  unit  wake  detector.1  This  detector  has  the  capa¬ 
bility  of  detecting  wakes  in  the  call  being  searched  which 
were  made  by  the  target  up  to  n  time  periods  earlier.  To 
extend  the  aolel  to  handle  *n-time  unit  wake  detectors*  two 
assumptions  are  made. 

First,  it  is  assumed  that  each  wake  search  for  each  time 
period  is  independent  of  all  other  searches.  For  example, 
whan  a  searcher  searchs  cell  2  at  time  period  3  with  a  2 
time  unit  wake  detector  ha  is  completing  three  separate  and 
independent  searches.  The  first  is  of  cell  2  looking  for  the 
wake  made  by  the  target  during  tima  period  3,  the  second  is 
of  cell  2  looking  for  the  wake  made  during  time  period  2, 
and  the  third  is  of  cell  2  looking  for  the  wake  made  during 
time  period  1.  Note  the  searcher  ha3  also  completed  a 
search  during  time  periods  2  looking  for  wakes  made  during 
time  periods  1  and  2,  and  a  search  during  time  period  1 
looking  for  wakes  made  during  time  period  1.  Therefore,  in  a 
3  time  period  search  with  a  two  time  period  detector  the 
searcher  has  made  a  total  of  6  indapendent  searches  in  3 
cells,  the  calls  he  chose  to  search  at  time  periods  1,  2, 
and  3. 

ilso  note  that  the  target  is  assumed  not  to  have  left  a 
wake  prior  to  the  start  of  the  problem  for  easa  of  computer 
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calculation  and  formulation  of  the  problem.  This  does  not 
restrict  the  result. 

The  second  assumption  is  that  ve  are  trying  to  calculate 
the  probability  of  non-detection  after  the  specified  length 
of  search  is  completed.  »e  are  not  trying  *o  evaluate  the 
probability  of  non-detection  at  intermediate  points  in  the 
search. 

Based  on  those  two  assumptions,  the  wake  detection 
concept  can  be  considered  a  simultaneous  search  of  the  cell 
the  searcher  is  in  now,  the  cell  the  searcher  will  be  in 
next  time  period,  the  cell  the  searcher  will  be  in  two  time 
periods  from  now,  etc.,  out  to  the  maximum  number  of  time 
periods  the  wake  is  detectable  or  to  the  number  of  time 
periods  remaining  in  the  problem,  waichever  is  smaller.  The 
wake  search  is  modeled  as  if  an  equivalent  search  is 
conducted  simultaneously  with  the  real-time  search,  i.e. 
searching  for  a  wake  in  call  j  which  is  t  time  periods  old 
is  equivalent  to  searching  in  cell  j  ,  t  time  periods 
previous,  simultaneously  with  the  other  searches  being 
conducted  t  time  periods  previous  and  waiting  t  time  periods 
to  discover  the  results  of  the  search. 

la  shewn  previously,  the  probability  of  non-detection 
for  the  search  without  wake  detection  can  be  calculated  from 
the  product  of  a  series  of  matricies  as  shown  in  equation 
3.1.  For  a  search  in  the  same  cells  but  with  a  one  tim® 
unit  wake  detector,  the  probability  of  non-detect ion  is 

Pnd«P0«S1  •S2*T*S2«S3*T«S3  •S4*T*S4*1  ].  (3.2) 

The  vector  Po,  as  defined  earlier,  is  the  probability 
that  the  target  is  in  cell  i  at  the  start  of  the  problem. 
The  vector  Po«S1  is  the  probability  the  target  was  in  cell  i 
at  time  period  1  and  has  not  been  detected  by  the  wake 


search  conducted  during  time  period  1  looking  for  a  wake 
left  in  time  period  1.  The  vector  Po«s1*S2  is  the  prob¬ 
ability  the  target  was  in  cell  i  at  time  period  1  and  has 
not  been  detested  by  wake  searches  during  time  periods  1  and 
2  looking  for  wakes  created  in  tiie  period  1.  The  vector 
Po»S1*S2«T  is  then  the  probability  that  the  target  is  in 
cell  i  at  tiae  period  2  and  has  not  been  detected  by  wake 
searches  locking  for  wakes  created  during  time  period  1. 

Following  the  same  line  of  reasoning,  the  vector 
Po«S 1 «S2«T*S2«S3 •T«S3«S4  is  the  probability  that  the  target 
is  in  cell  i  at  tiae  period  3  and  has  not  been  detected  by 
wake  searches  looking  for  wakes  created  during  time  period  3 
and  prior.  Of  note  is  the  idea  that  the  searcher  in  effect 
conducts  simultaneous  searches  of  2  cells  during  a  giver, 
tiae  period  but  does  not  receive  the  results  of  the  ore  time 
unit  wake  search  until  the  next  time  period. 

The  wake  detection  problem  is  analagous  to  the  problem 
where  a  homeowner  thinks  there  are  mice  in  his  house  and  he 
wants  to  confirm  his  suspicions.  Each  room  of  the  house  has 
two  tape  recorders:  one  which  is  available  for  replay  of 
what  noises  were  recorded  in  the  pravious  hour  and  the  other 
which  is  recording  the  current  hour.  The  owner  car.  only  go 
to  adjacent  rooms  which  have  doors  to  the  current  room.  He 
spends  one  hour  in  the  room  of  his  choice  listening  for 
mice.  Once  in  a  room  he  can  listen  for  mice  and  at  the  same 
time  listen  to  the  tape  recording  of  the  previous  hour.  The 
probability  of  detecting  the  mice  on  the  tape  recorder  or  by 
listening  in  a  room  is  the  same.  The  owner  now  must  decide 
how  to  search  the  house  to  maximize  his  chances  of  finding 
the  mice. 

The  tape  recordings  of  the  noise  in  each  room  are  esen- 
tially  independent  and  simultaneous  searches  of  each  room  in 
the  house.  The  owner  can  only  determine  the  results  of  the 
search  by  tape  recorder  if  he  enters  the  room  and  listens  to 


the  tape  recorder.  If  the  owner  doesn’t  listen  to  the  tape 
recorder  daring  the  hoar  the  second  recorder  is  taping  the 
room,  the  first  recorder  is  rewound  and  starts  taping  thus 
destroying  the  results  of  that  particular  search. 

The  key  assumptions,  as  stated  earlier,  are  that  the 
searches  are  independent  and  that  the  goal  is  to  minimize 
the  probability  of  non-detection  over  a  given  search  length. 
Therefore  the  matrix  multiplication  in  equation  3.2  is 
valid.  For  a  two  time  unit  detector,  the  probability  of 
non-detection  is 


Pnd*Po*S1  »S2  •  S3*T<*S2*S3«S4»T»S3«*S4*T*S4*1  ].  (3.3) 

The  matrix  multiplication  can  be  extended  for  a  Tl  capacity 
wake  detector  where  Tl  is  the  time  late  a  searcher  can  enter 
a  cell  and  still  detect  the  target’s  wake.  For  the  Tl 
capacity  detector  equation  3.2  becomes 


Pnds*PO*ST1«T«sS*T»ST5*T«ST4*.  ..•STmax^l  ]. 


where 


__  min (Tmax,  i+Tl) 

Sfl  -  n  St(j) 

j»i 


(3.4) 


(3.5) 


I?.  RESULTS 


i.  DESCRIPTION  OP  THE  COHPOTER  PBOSRiS 

The  algorithms  presented  in  the  preceding  chapters  were 
implemented  oa  the  tJ.S.  Naval  Postgraduate  School’s  IBS  3033 
computer  system  in  Fortran  H  (extended) .  The  program  was 
constructed  of  a  main  driver  program  which  called  various 
subroutines  for  input,  calculation  and  output. 

The  operation  of  the  program  can  be  broken  down  into  two 
main  functions:  1)  generation  of  the  problem  including  the 
initial  target  distribution,  the  transition  matrix  and  the 
searcher  xovement  constraint  matrix;  and  2)  solution  of  the 
generated  problem. 

The  generation  of  the  problem  used  two  methods.  In  one 
method  the  problem  generated  was  a  deterministic  one  where 
the  target* s  initial  position  was  at  the  far  corner  away 
from  the  searcher  who  started  in  cell  1.  The  target  tran¬ 
sition  matrix  was  generated  assuming  that  the  target  had  a 
fixed  probability  of  staying  in  tha  call  it  currently  occu¬ 
pied  and  the  remaining  probability  of  movement  was  divided 
evenly  among  the  cells  which  were  adjacent.  Diagonal  move¬ 
ment  was  not  allowed.  Figure  4.1  shows  a  example  initial 
target  distribution  and  target  transition  matrix  for  the 
deterministic  case.  Tha  searcher  movement  constraint  matrix 
was  generated  by  allowing  the  searcher  to  move  only  from  the 
current  cell  to  an  adjacent  cell. 

In  the  second  method,  the  problem  was  randomly  gener¬ 
ated.  The  target  was  randomly  distributed  between  all  the 
C9 11s  at  the  start.  The  target  transition  matrix  was  gener¬ 
ated  assuming  a  fixed  probability  of  remaining  in  the 
current  cell  and  then  the  remaining  probability  of  movement 
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Figure  4.1  Example  Deterministically  Generated  Problea 


was  randomly  distributed  aaong  tie  adjacent  cells, 
searcher  movement  constraint  matrix  was  determined 
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Figure  4.2  Example  Randomly  Generated  Problem. 


before.  Figure  4.2  illustrates  a  typical  random  problem. 
Figure  4.3  shows  the  program  structure  and  subroutines  used 
to  generate  the  deterministic  and  random  problems.  The 
program  requires  6  inputs  as  defined  below: 

1.  Size  of  the  grid  i.  e .  3x3,  4x4,  etc. 

2.  Probability  of  detection  of  the  target  if  the 
searcher  and  target  are  in  the  same  cell.  Also  used 
as  the  probability  of  detection  of  the  target  using 
the  wake  detector. 

3.  Fixed  probability  of  the  target  staying  in  the  cell 
it  currently  occupies,  (i.e.  rii) 
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Whether  the  generated  problem  is  to  be  deterministic 
or  random. 

5.  Epsilon,  used  as  a  stopping  criteria  for  Brown's 
algorithm. 

6.  The  capability  of  the  wake  detector,  (i.e.  how  many 
time  units  late  will  the  detector  detect  a  wake.) 

Once  the  problem  was  generated  it  was  then  necessary  to 
find  the  optimal  solution  using  the  various  algorithms 
mentioned  earLier.  seven  algorithms  were  used  to  find  the 
solution: 

1.  Depth-First  search  using  the  myopic  solution  to  start 
Brown's  algorithm. 

2.  Depth-Pirst  search  using  a  randomly  chosen  solution 
to  start  Brown's  algorithm. 

3.  Depth-Pirst  search  using  a  random  solution  to  start 
Brown's  algorithm  and  using  the  modification  which 
restarted  Brown's  algorithm  every  time  the  solution 
was  changed. 

4.  Best -First  search  using  the  myopic  solution  to  start 
Brcwn's  algorithm. 

5.  Best-First  search  using  a  randomly  chosen  solution  to 
start  Brown's  algorithm. 

6.  Best -First  search  using  a  random  solution  to  start 
Brown's  algorithm  and  using  the  modification  which 
restarted  Brown's  algorithm  every  time  the  solution 
was  changed. 

7.  Total  enumeration  of  all  possible  search  solutions  to 
determine  the  one  with  the  lowest  probability  of 
non-detection. 

The  only  algorithm  guaranteed  to  produce  the  optimal 
solution  was  the  total  enumeration  algorithm  which  generated 
all  possible  feasible  solutions.  Figure  4.4  shows  the 
program  structure  and  subroutines  necessary  to  implement  the 
algorithms  and  problem  soluticn  part  of  the  program. 
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The  output  generated  by  the  program  included: 

1.  cpu  seconds  used  by  each  algcritha 

2.  number  of  unconstrained  solutions  checked 

3.  number  of  constrained  solutions  checked 

4.  probability  of  detection  of  the  target  af*er  search 

5.  search  plan  used 

Figure  4.5  presents  an  example  program  output. 


THE  TARGET  TRANSITION  MATRIX 


.40 

.30 

.30 

.0 

.30 

.40 

.0 

.30 

.30 

.0 

.40 

.30 

.0 

.30 

.30 

.40 

THE 

0.0 

TARGET 
0.0  0 

INIT 
.  0 

PROBABILITY  DISTRIBUTION 


THE  SEARCHER  MOTION  CONSTRAINT  MATRIX 


NUMBER  OF  CELLS  IS  4 

THE  PROBABILITY  OP  NON- DETECTION  IS  0.500 
THE  INITIAL  SEARCH  CELL  IS  0 

THE  ALGORITHMS  USED  ARE: 

1  -  DEPTH  FIRST  STRATEGY,  MYOPIC  INITIAL  SEARCH 

2  -  DEPTH  FIRST  STRATEGY,  RANDOM  INITIAL  SEARCH 

3  -  DEPTH  FIRST  STRATEGY,  RESTART  AFTER  EACH  CHANGE 

4  -  BEST  PIRST  STRATEGY,  MYOPIC  INITIAL  SEARCH 

5  -  BEST  PIRST  STRATEGY,  RANDOM  INITIAL  SEARCH 

6  -  BEST  PIRST  STRATEGY,  RESTART  AFTER  EACH  CHANGE 

7  -  TOTAL  ENUMERATION 


SEARCH  PLANS  FOR  TMAX  = 


TIME 

0.02 

0.02 

0.02 

0.01 

0.01 


♦UNC 


4  AND  TL*  0 

#CON  P(D)  SEARCH  PLAN 

3  0.3900  1244 

3  0. 390C  1244 

3  0.3900  1244 

0  0.3900  1244 

0  0.3900  1244 

0  0.3900  1244 

27  0.3900  1244 


Using  the  program  described  above,  grid  sizes  of  4,  9, 

16,  and  25  oell3  were  investigated.  All  seven  algorithms 
were  tested  on  deterministic  problems  with  Tmax=2 ,  10  and 
Tl*0,1,2.  While  the  problem  sizes  considered  are  not  large 
enough  for  real  life  problems  it  was  felt  that  they  were 
large  enough  to  demonstrate  the  algorithms.  The  results  can 
then  be  extrapolated  to  determine  expected  running  times  for 
real  life  problems.  The  goal  was  to  answer  two  questions: 

1.  How  close  to  the  optimal  are  the  solutions  from  the 
branch-and-bound  algorithms? 

2.  How  do  the  running  times  of  the  algorithms  compare; 
to  each  other,  and  to  the  total  enumeration  algo¬ 
rithm? 

B.  OPTIH1LITT  OP  THE  1LGOB ITHH  OUTPUT 

As  mentioned  earlier,  the  problems  under  consideration 
ranged  from  a  4  cell  grid  with  Tmar*2  and  T1=0  to  a  25  cell 
grid  with  Tmax=10  and  Tl*2 .  The  total  number  of  possible 
constrained  solutions  ranged  from  3  to  275905.  Table  I  shows 
the  number  of  non-optimal  solutions  and  the  maximum  percent 
difference  between  the  optimal  and  non-optimal  solutions  for 
each  of  the  algorithms.  Since  the  problems  were  symmetric 
there  were  several  optimal  solutions,  so  the 

branch-and-bound  solution  could  be  an  equivalent  although 
different  solution  from  the  total  enmeration  solution.  This 
may  have  increased  the  probability  of  the  branch-and-bound 
algorithms  finding  the  optimal  solution.  Further  investiga¬ 
tion  into  larger  random  problems  may  yield  more  non-optimal 
solutions  and  larger  percent  differences,  however,  fully  96* 
of  Stewart’s  results,  as  reported  in  [Ref.  1],  were  optimal 
with  the  non-optimal  results  being  within  .41*  of  the 
optimal  solution.  Therefore,  the  results  of  this  run  tend  to 
confirm  Stewart’s  results  concerning  the  optimality  of  the 
branch-and-bound  algorithm  solutions. 


TABLE  I 

Hon-Optisal  Solutions 


Humber 

of  Hon-optimal 
Solutions 


Algorithms 

1  2  3  4  5 

2  0  3  2  1 


6 

0 


Maximum  percent  .04%  0%  3%  .04%  .31% 

Error 


0% 


C.  BUI  TIHE  30HPABISOH  OF  THE  ALGORITHMS 

Since  all  the  algorithms  seem  to  be  able  to  find  the 
optimal  or  near-optimal  solution  without  too  much  diffi¬ 
culty,  it  Is  now  important  to  determine  which  algorithm 
performs  the  fastest,  while  the  total  enumeration  algorithm 
was  used  to  provide  a  benchmark  for  the  optimality  of  the 
solutions  it  can  also  serve  as  a  benchmark  for  the  run-time 
of  the  algorithms. 

The  running  time  of  the  total  enumeration  algorithm  is  a 

function  of  the  number  of  possible  feasible  solutions.  The 

number  of  feasible  solutions  is  based  on  how  many  places  the 

searcher  can  go  from  the  cell  he  currently  occupies.  From 

each  cell  the  searcher  can  transition  to  between  3  and  5 

cells.  If  the  searcher  is  in  a  corner  cell  he  can  stay  where 

he  is  or  transition  to  either  of  the  two  cells  which  border 

the  cell  he  is  in.  If  the  searcher  is  in  a  side  cell  he  can 

stay  where  he  is  or  transition  to  any  of  the  three  border 

cells.  If  tie  searcher  is  in  an  interior  cell  he  can  again 

stay  where  he  is  or  transition  to  any  of  the  four  border 

cells.  Therefore  the  total  number  of  feasible  solutions  is 

Taax 

bounded  below  by  the  exponential  function  3  ,  where  Tmax 
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is  the  length  of  the  search.  The  number  of  feasible 

solutions  is  bounded  above  by  tha  exponential  function 

Taax 

5  .  Since  the  total  enumeration  algorithm  looks  only  the 

feasible  solutions  and  calculates  Pad  for  each  one  the  algo- 

Tmax 

ritha  is  therefore  0  (e  )  or  of  exponential  complexity. 

The  branch -and- bound  algorithms  don't  lend  themselves  to 
such  easy  analysis.  The  worst  case  analysis  would  be  where 
the  bounds  are  so  weak  that  all  the  feasible  solutions  would 
have  to  be  checked.  The  average  case  analysis  is  much  more 
difficult.  Smith  in  [8ef.  argued  that  the  best-first 

strategy  had  a  smaller  average  case  complexity  than  the 
depth-first  strategy.  Since  it  is  unclear  whether  the  trees 
generated  by  the  search  problem  fit  into  the  class  of  random 
trees  covered  by  Smith's  argument,  further  complexity  anal¬ 
ysis  will  not  be  attempted. 

Appendix  B  contains  graphs  of  the  run-time  for  all  seven 
algorithms  for  all  the  cases.  Prom  the  graphs  it  is  clear 
that  the  best-first  strategy  did  outperform  the  depth-firs4- 
strategy  especially  as  the  problem  (as  measured  by  the 
number  of  possible  feasible  solutions)  increased  in  diffi¬ 
culty.  This  is  supported  by  analyzing  the  number  cf  solu¬ 
tions  checked  by  each  algorithm.  Table  II  shows  the  number 
of  solutions  checked  by  each  algorithm  for  the  25  cell  grid 
with  Tl*2. 

Prom  table  II  it  appears  that  until  time  period  6  th® 
algorithms  looked  at  all  the  possible  solutions.  Since  the 
total  enumeration  algorithm  didn't  look  at  any  intermediate 
solutions  it  was  faster.  After  time  period  6  the 
branch-and-boand  algorithms  where  able  to  use  the  pruning 
feature  to  a  great  extent  in  removing  unpromising  branches. 
Table  III  shows  the  runtimes  needed  to  used  in  generating 
the  solutions  in  table  II.  Based  on  the  number  of  solutions 
calculated  by  each  algorithm  it  appears  that  the  best-first 
strategy  is  more  efficient,  since  the  best-first  strategy 
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T ABLE  II 

Number  of  solutions  for  25  Cell  Grid,  11*2 


Taaz 


PARTIAL!!  CONSTRAINED  SOLUTIONS 
(Brown's  Algorithm  Output) 

Algorithm 

12  3*5 


Totals 


Taaz 


0 

0 

0 

0 

0 

0 

3 

3 

3 

3 

3 

3 

14 

14 

14 

14 

14 

14 

57 

57 

57 

57 

57 

57 

2  34 

234 

234 

234 

234 

234 

983 

983 

983 

983 

983 

983 

21  16 

2109 

2402 

1123 

1  123 

1 123 

i?K 

4215 

2309 

1573 

1593 

1598 

4066 

4532 

1375 

1359 

1383 

10182 

11591 

10534 

5362 

5366 

5  395 

CONSTRAINED  SOLUTIONS 
Algorithm 

2  3  4  5 


Totals 


11 

11 

11 

11 

11 

1 1 

11 

43 

43 

43 

4  3 

43 

43 

43 

177 

177 

177 
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177 

177 

177 

749 

749 

749 

749 

749 

74  9 

74  9 

916 

563 

386 

100 

100 

100 

3235 

1273 

987 

1  439 

0 

0 

0 

14139 

601 

1552 

723 

160 

160 

160 

62309 

246 

251 

765 

0 

0 

0 

275905 

4019 

4336 

4  296 

1243 

1243 

1243 

356571 

algorithms  had  almost  ezactly  the  sane  number  of  solution 
calculations  whereas  the  depth-first  strategy  algorithms 
were  more  divergent  it  could  be  hypothesied  that  the  best- 
first  strategy  is  more  tolerant  of  the  non-optimal  bounds 
produced  by  Brown's  algorithm. 

Table  I?  shows  how  the  number  of  solutions  varied  for 
all  the  cases  where  Tmaz=10  (i.e.  where  the  mazimum  number 
of  possible  feasible  solutions  was  ooted.) 


TABLE  III 

Algorithm  Runtimes  for  25  Tall  Grid,  Tl= 2 


Tmax 

1 

2 

3 

Algorithm 

4  5 

6 

7 

2 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.  0 

3 

0.2 

0.2 

0.  1 

0.2 

0.2 

0.  1 

0.0 

4 

1.2 

1.2 

0.9 

1.2 

1.2 

0.8 

0.  1 

5 

5.8 

6.6 

4.5 

5.  7 

6.4 

4.6 

0.  3 

6 

26.  5 

27.8 

2  1.5 

26.2 

27.3 

22.2 

1.8 

7 

112.3 

118.3 

92.6 

105.0 

113.5 

87.8 

9.  3 

8 

331. 4 

342.6 

344.4 

240.9 

253.3 

278.9 

48.2 

9 

821 .4 

868.2 

794.5 

531.9 

547.5 

743.6 

248.  1 

10 

1253. 4 

1500.3 

225  2.4 

843.0 

845.0 

1494.1 

1249. 1 

Totals 

2552.2 

2865.2 

351 0.9 

1755. 0 

1 794 .4 

26  32.1 

1556.9 

runtime  in  cpu  seconds 


Table  V  tabulates  the  running  tine  required  to  generate 
tt9  solutions  for  the  cases  where  Tiax=10.  Prom  the  tables 
it  can  be  seen  that  the  best-first  strategy  dominated  the 
depth-first  strategy,  mainly  because  it  had  to  look  at  fewer 
solutions.  Also  it  can  be  seen  that  the  restart  algorithm 
was  not  competitive  when  rmax=10  for  any  of  the  cases.  This 
reflects  the  fact  that  it  must  restart  after  every  change  in 
the  current  solution  and  as  Tmax  increases  the  number  of 
changes  also  increases.  Therefore  the  restart  algorithm  is 
forced  to  restart  significantly  more  frequently  and  thus 
takes  longer  to  arrive  at  the  local  bound.  Proa  table  IV  it 
is  seen  that  the  extra  time  taken  to  calculate  the  bound  did 
not  reduce  the  number  of  solutions  which  were  investigated. 

It  is  apparent  that  the  best-first  strategy,  using 
either  the  myopic  or  random  starting  solution,  performed 
very  well  whea  compared  to  ar.y  of  the  other  algorithms.  As 
expected,  the  runtime  for  the  total  enumeration  algorithm 


T ABLE  IT 

Hasher  of  Solutions  for  Taax*10,  ill  Cases 
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PARTI  ALLY  CONSTRAINED  SOLUTIONS 
(Brown's  Algoritha  Output) 
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0 

Totals 
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TOTALLY 

CONSTRAINED 

SOLUTIONS 
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2 
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3 

Algorithms 
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6 

7 

0 
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4 
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3 

3 

6 

3 

3 

3 
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2 

3 

3 

6 

3 

3 

3 

1968  3 

0 

31 

27 

10 

0 

0 

0 
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9 

1 

14 

32 

23 

0 

0 

0 
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2 

63 

5 

53 

45 

54 

8  1 
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0 
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0 

0 

0 

230175 

16 

1 
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19 

19 

0 

0 

0 
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2 

63 
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90 

0 

0 

0 
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0 
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4  79 
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0 

0 

0 
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25 

1 
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1240 

10 

0 

0 

0 
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2 

246 
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0 

0 

0 

275905 

Totals 

34  25 

2762 

2368 

240 

255 

282 

1963434 

increased  rapidly,  and  it  appears,  exponentially.  The  other 
alogorithis,  all  the  depth-first  algorithms  and  the 
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vWa  A-.V.v-  C  V-V'  O  . 


Grid 

Tl 

Algorithm  Bunt 

TABLE  7 

ime  for  Tmax*10,  m 
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Size 
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2 

3 

4 

5 

6 

7 
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4. 3 

4.4 

3.7 

4.  1 
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3.6 

10.4 
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0.4 

0.4 

0.7 

0.  4 

0.4 

0.6 

10.7 

2 

0.7 

0.4 

1.1 

0.  9 

0.6 

0.8 

10.9 

0 

17.9 

16.  1 

1  8.8 

10.  4 

8.0 

17.6 

15  0.8 

9 

1 

14.7 
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1  9.7 

3.  8 

6.9 

15.0 

15  2.  1 

2 

14.3 

8.2 

25.3 

10.  9 

9.0 

17.1 
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0 

120.8 

92.1 

19  1.8 

1  13.  1 
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212.7 
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16 

1 

174.0 

1 19.4 

22  1.5 

1 19.  2 

114.9 

220.4 

671.  9 

2 

163.4 

193.8 

31  8.3 

156.4 

125.4 

250.2 

674.  8 

0 

661.0 

679.2 

1028.6 

561.9 

547.8 

1094.6 

1249.3 

25 

1 

1  124.4 

1092.0 

1277.3 

709. 8 

698.9 

1262.0 

1244.  5 

2 

1253.4 

1500.3 

225  2.4 

843.  0 

845.0 

1494.1 

1249. 1 

Totals 

3549.3 

3734.9  5359.2  2538.9 

runtime  in  cpu 

2461 .8 

seconds 

4588.7 

6250.9 

J 

best-first  restart  algorithm,  tended  to  be  somewhere  between 
the  two  extremes.  In  the  final  case,  where  Tmax=lO  and 
Tl*2,  the  total  enumeration  algorithm  was  still  competitive. 
It  is  anticipated  that  as  Tmax  is  increased  beyond  10  the 
total  enumeration  algorithm  will  surpass  all  the  other  algo¬ 
rithms  in  runtime  required. 

Based  on  this  example,  it  appears  that  the  best-first 
strategy  with  either  the  myopic  or  random  starting  solution 
is  preferred.  Further  examples  might  indicate  a  preference 
between  the  myopic  and  random  starting  solutions. 


X.  EXTENSIONS 


A.  PO  AS  A  FUNCTION  OP  WAKE  AGE 

The  program  as  currently  written,  assumes  that  the  prob¬ 
ability  of  detection  of  the  wake  is  constant  with  the  age  of 
the  wake.  In  reality,  one  would  expect  the  probability  of 
detection  to  decrease  as  the  wake  age  increased.  This  would 
relatively  simple  to  implement.  What  would  be  needed  would 
be  either  a  separate  probability  of  detection  as  the  wake 
aged  or  a  functional  relationship  between  wake  age  and  prob¬ 
ability  of  detection.  The  program  would  then  have  to  be 
modified  to  use  the  appropriate  probability  for  the  various 
search  aatrides,  St  (i) . 

B.  COUNTIH -DETECTION 

Another  aspect  of  interest  is  the  idea  of  counter-detection 
of  the  searcher  by  the  target.  It  could  be  speculated  that 
if  the  target  detected  the  searcher  when  they  were  both  in 
the  same  cell  at  the  same  time,  the  search  would  be  blown 
and  therefore  any  target  probability  mass  which  detected  the 
searcher  could  be  removed  from  the  problem.  one  way  of 
accomplishing  this  would  be  to  have  an  added  cell  to  the 
grid.  The  searcher  would  be  unable  to  search  this  cell  and 
the  target  once  in  the  added  cell  would  never  transition 
out.  Then  two  search  matricies  would  have  to  be  used.  The 
modified  search  matrix  St'  would  include  a  probability  of 
oounter-det action  and  a  transition  of  that  target  prob¬ 
ability  mass  which  counter-detected  into  the  extra  cell. 
The  search  matrix  St  for  the  wake  search  would  remain 
unchanged.  Pigure  5.1  illustrates  the  problem  input, 
initial  probability  distribution,  target  transition  matrix, 
and  example  search  matricies. 
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Sample  Z rid 
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The  target  transition  matrix 
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.0 
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.0 
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.30 

.30 
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.0 

0 

.0 

.0 

.0 

1.0 

The  target  initial  probability  distribution 

P0«  0.00  0.00  0.00  1.00  0.00 

The  searcher  motion  constraint  matrix 

1  2  3  0  0 

1  2  4  0  0 

1  3  4  0  0 

2  3  4  0  0 

5  0  0  0  0 

The  probability  of  non-detection  is  0.500 
The  probability  cf  counter-detection  is  0.200 

Example  Search  Hatricies  for  a  search  in  cell  1 


Si  (1) 


Original  Wake  Search  wa 

trix 

0.50 

0.  0 

0.0 

0.  0 

0.0 

0.0 

1. 00 

0.0 

0.0 

0.0 

0.0 

0.  0 

1.00 

0.0 

0.0 

0.0 

0.  0 

0.0 

1.  00 

0.0 

0.0 

0.  0 

0.0 

0.0 

1.00 

Modified  Seal 
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C.  APPROXIMATIONS  TO  THE  OPTIMAL  SOLUTION 


Por  real  life  problems  on  the  order  of  25x25  grids  and 
larger  with  Tiax>50  and  Tl>5,  the  computer  time  to  reach  a 
close  approximation  of  the  optimal  solution  say  be  exces¬ 
sive.  Therefore,  Stewart  in  [ Hef .  1]  suggested  using  the 
first  feasible  solution  that  arose  from  the  depth  first 
search.  The  first  solution  could  be  viewed  as  a  form  of  the 
myopic  search.  The  optimality  characteristics  of  such  a 
solution  have  not  been  subjected  to  worst  case  or  average 
case  analysis. 


▼I.  COHCIOSIDHS 


1.  PBOBLEH  CD  HP  LB X  ITT 

Mention  has  been  made  of  the  apparently  fundamental 
intractability  of  the  discrete  tiaa  and  space  moving  target 
constrained  searcher  problem.  Earlier  it  was  conjectured 
that  the  problem  is  at  least  SP-Complete  and  possible 
HP-Hard.  Appendix  k  discussed  the  complexity  of  the  problem 
and  provides  soae  justification  for  the  conjecture. 

If  the  conjecture  is  true  than  the  implications  are 
clear.  conventional  attaapts  at  trying  to  find  ’efficient' 
algorithas  are  doomed  to  failure,  particularly  if  the 
problem  is  HP-Hard.  Thus  heuristic  algorithms  are  the  most 
fruitful  avenue  for  finding  optimal  or  near-optimal 
solutions. 

B.  CHOICE  OP  AH  ALSOHITHH 

The  myopic  starting  solution  for  3rown's  algorithm 
combined  with  the  best-first  strategy  produces  the  best 
results.  This  combination  was  consistently  better  than  the 
total  enumeration  algorithm  and,  as  the  problem  became  more 
difficult,  performed  better  than  the  other  five  variations. 

The  solutions  to  the  constrained  searcher  problem 
(Stewart's  algorithm  output)  were  compared  for  both  opti¬ 
mality  and  runtime.  However,  the  solutions  to  the  uncon¬ 
strained  searcher  (Brown's  algorithm  output)  were  not 
compared  except  indirectly  as  the  output  affected  Stewart's 
algorithm.  There  may  be  significant  differences  in  the 
bounds  provided  by  the  different  variations  of  Brown's  algo¬ 
rithm.  It  did  appear  that  the  restart  approach  was  signifi¬ 
cantly  slower  as  Tmax  increased.  This  had  a  significant 


effect  on  the  performance  of  Stewart's  algorithm.  As  Tmax 
increased  the  restart  approach  became  increasingly  slower 
than  the  myopic  or  randoa  approaches  and  the  difference 
coaid  not  be  explained  by  a  change  in  the  number  of  solu¬ 
tions  which  had  to  be  calculated.  Thus  even  if  the  opti- 
■ality  of  the  bounds  produced  by  the  restart  approach  was 
improved  over  the  other  approaches,  it  was  overshadowed  by 
the  increased  time  requirad.  It  is  conjectured  that  the  same 
effect  would  occur  if  the  estimation  technique  were  used. 

There  are  several  altarnative  ways  to  approach  the  solu¬ 
tion  of  the  constrained  searcher  problem.  As  shown  by 
Stewart  in  (Ref.  11,  the  idea  of  network  flows  could  be 
applied.  Also,  J.N.  Eagle  in  [Ref.  S]  proved  that  a  dynamic 
programming  approach  was  guaranteed  to  provide  an  optimal 
solution  for  the  non-wake  search  constrained  searcher 
problem.  Either  of  the  above  approaches  may  be  extendable 
to  the  wake  search  case. 


C.  RAKE  SEARCH 


Tha  extension  of  the  constrained  searcher  problem  to 
deal  with  wakes  rested  on  two  assumptions:  1)  the  indepen¬ 
dence  of  the  searches  and  2)  the  goal  of  minimizing  tha 
probability  of  non-detection  for  a  fixed  time  period  search. 
The  first  assumption  may  not  in  fact  be  valid  under  all 
conditions.  To  say  that  two  searches  have  independent  prob¬ 
abilities  of  detecting  a  target  when  the  searches  are 
constrainedl  to  use  the  same  search  path  might  be  incorrect. 

For  example,  suppose  that  at  time  period  i  the  target 
moved  from  North  to  South  in  cell  j.  Also  suppose  that  in 
time  period  i  +  2  the  target  moved  from  East  to  Rest  in  the 
same  cell  j.  Now  the  searcher  enters  the  cell  at  time 
period  i+4  with  a  5  time  unit  wake  detector.  If  the  searcher 
uses  a  search  plan  that  searches  from  East  to  Rest  in  an 
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exhaustive  fa3hioa  he  has  several  chances  and  thus  a  higher 
probability  of  detecting  the  tiie  period  i  wake  than  ths 
ties  i+2  wake.  Conversly  if  the  searcher  uses  an  exhaustive 
search  path  fro a  north  to  South  he  will  have  several  chances 
to  detect  the  wake  fros  tiie  period  i+2.  Therefore  it  may  be 
an  oversisplif ication  to  assume  that  the  wake  searches  are 
all  independent  of  each  other.  The  assumption  did  make  the 
calculations  possible  and  therefore  even  if  the  assumptions 
stretches  the  truth  it  will  still  yield  answers  cf  interest. 

D.  1CKN09LBDGS9  BUTS 

The  basic  idea  underlying  this  thesis,  that  of  investi¬ 
gating  applications  of  optimal  search  theory  techniques  to 
wake  search,  was  suggested  to  me  by  Dr.  Steven  MacGruder 
at  the  Applied  Physics  Laboratory  of  Johns  Hopkins 
University.  H9  was  interested  in  studing  the  exploitability 
of  wakes  in  general  and  had  been  using  heuristic  techniques 
to  determine  reasonable  search  strategies.  After  a  6  week 
experience  tour  working  under  Dr.  SacGruder  I  returned  to 
the  Naval  Postgraduate  School  where  I  worked  closely  with 
Professor  Eagle  in  completing  this  thesis. 


4E2SS2II  4 

DISCUSSION  OP  THE  COHPLBXITY  OP  THE  SEARCH  PROBLEM 


In  this  appendix,  I  hope  to  lay  the  foundation  for  the 
determination  of  the  coeplaxity  of  the  wake  search  problem. 
The  problem  will  be  approached  in  two  ways: 

1.  Show  a  restricted  version  of  the  constrained  wake 
search  problem  is  an  element  of  NP. 

2.  Show  that  the  unconstrained  wake  search  problem  is 
functionally  similar  to  tha  Knapsack  Problem  which 
has  been  shown  to  be  HP-Complete. 

As  defined  in  [Ref.  3],  a  problem  is  in  NP  if  a  tenta¬ 
tive  solution  can  be  written  down  and  checked  in  time  poly¬ 
nomial  in  the  site  of  the  problem  input.  The  wake  search 
problem  can  be  formulated  as  follows: 

INPUT:  A  finite  set  J*  (jl ,  j2 ,. . .  ,  jn}  of  calls  which  can 
be  searched,  a  probability  PO*  {pi  ,p2, . . .  ,pn} ,  3<pi<1  for  all 
i»1,N  that  the  target  will  start  the  problem  in  each  cell,  a 
probability  Tij,  0<Tij<1  for  all  i*1,N,  j*1,N  that  the 

target  will  move  from  cell  i  to  cell  j,  a  bound  B>0,  and  the 
sets  I(ji)  for  each  ji,  a  subset  of  J  containing  the  cells 
reachable  fro*  cell  ji  in  the  next  time  period. 

QUESTION:  Is  there  a  "search"  of  the  cells  in  J  of 
length  T  having  a  total  probability  of  non-detection  no  more 
than  B  such  that  each  jt+1  is  an  element  of  I  (jt)  ?  The  prob¬ 
ability  of  non-detection  is 


Pnd*Po*ST1  •T*§t5»T«ST3 »T» . . .  *STmax*  1  ]  (A.1) 

Given  the  above  problem  definition,  what  non- 
deterainistic  algorithm  will  solve  it  in  polynomial  time?  A 
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non-deterministic  algorithm  is  ana  which  contains 
stages;  a  guessing  stage  which  siiply  guesses  an  arbitrary 
search  j1,j2,.  .  .,jT  and  a  polynomial  time  "checker"  which 
answers  the  question,  "does  the  arbitrary  search  have  a 
non-detection  probability  less  thaa  B?"  It  will  suffice  to 
show  that  the  "checker"  will  stop  in  polynoaial  tine  and 
answer  the  question,  yes  or  no. 

The  "checker"  sorely  calculates  the  probability  of  non¬ 
detection  using  equation  A.  1  and  cospares  the  result  with  B. 
The  calculation  entails  (T-1) ♦ (T»ri) ♦ 1  matrix  multiplica¬ 
tions  each  of  which  requires  NxB  multiplications.  Therefore, 
the  calculation  will  require  0(T»T1«B*)  time  to  complete. 
The  input  to  the  problem  has  length  0(N*+log(T)  ♦  log  (Tl) )  (ft 
elements  of  PO,  ft*  elements  of  Tij,  at  most  ft*  elements  of 
I(ji) *  V  elements  of  the  guessed  search  and  the  values  of  T 
and  Tl.)  If  T  and  T1  are  restricted  to  be  less  than  or 
equal  to  some  specified  polynomial  function  of  ft ,  P  (N)  ,  then 
the  input  becomes  0(P(8)«B*)  and  the  calculation  time 
becomes  0(P(N)*»8*),  both  of  which  are  polynomial  in  ft. 
Therefore  the  "Checker"  will  answer  the  question  in  polyno¬ 
mial  time  based  on  the  length  of  the  input.  Based  on  the 
above,  the  wake  search  problem  is  in  ftp.  If  the  restriction 
on  the  size  of  T  and  Tl  are  removal  the  problem  may  not  be 
in  BP,  i.e.  the  problem  may  be  NP-Hard. 

Once  it  has  been  shown  that  a  given  problem  is  in  ftP,  it 
is  of  interest  to  see  if  the  problem  belongs  to  the  class  of 
problems  called  BP-Complete.  This  class  of  problems  is  known 
to  be  the  set  of  the  hardest  problems  in  BP.  It  is  conjec¬ 
tured  that  the  wake  search  problem  as  described  above  is  no 
easier  than  the  BP-Complete  problems,  however,  a  proof  is 
not  available.  Following  is  a  partial  justification  for  the 
conjecture. 

Proof  that  a  problem  is  BP-Complete  can  be  done  by 
showing  equivalence  between  the  given  problem  and  a  problem 


already  shown  to  be  NP-Complete.  As  shown  above,  a 

restricted  version  of  the  wake  search  problem  is  in  HP.  Now 
if  it  could  be  shown  that  the  wake  search  problem  is  no 
easier  than  a  problem  which  is  HP-Complete  the  proof  would 
be  done.  Shat  will  be  done  is  to  show  that  a  relaxed  version 
of  the  wake  search  problem  namely  the  wake  search  problem 
where  the  searcher  motion  is  unconstrained  is  functionally 
similar  to  the  knapsack  problem  whioh  is  NP-Complete. 

The  knapsack  problem  can  be  stated  as  follows: 

GIVEN:  Finite  set  0,  for  each  u  0  a  size  s(u)  Z+  and  a 
value  v(u)  Z+,  and  positive  integers  B  and  K. 

QUESTION:  Is  there  a  subset  U'  of  U  such  •‘that 

£  s (u)  <B  and  such  that  1  v(m>K? 
ueU1  ueO* 

The  unconstrained  searcher  problem  can  be  stated  as 

follow s: 

GIVEN:  a  finite  set  JxTmax,  a  finite  set  T,  a  finite  set 
Po,  for  each  jt  JT  a  size  s(ji)*1  and  a  value  v(ji)*Pnd,  and 
a  positive  integer  Tmax  and  a  rational  number  K<1. 

QUESTION:  is  there  a  search  J*(j1 ,  jTmax}  a  subset  of 
JxTmax,  such  that  each  element  ji  of  J  is  an  elemen*  of  the 

disjoint  subset  Jl  where  the  subsets  Jl  form  a  partition  of 

Tmax 

JxTmax  and  such  that  Z  s(ji)*Tmax  and  such  that  equation 

i»1 

A.  1  <K? 

While  there  appears  to  be  significant  differences 
between  the  wake  search  problem  and  the  knapsack  problem, 
there  is  enough  similarity  that  tha  conjecture  that  the  wake 
search  problem  is  at  least  as  hard  as  the  knapsack  problem 
is  reasonably  justified.  since  tha  wake  search  problem  as 
compared  to  the  knapsack  problam  is  th9  unconstrained 
version  it  also  appears  that  the  constrained  wake  search  is 
also  at  least  as  hard. 

It  has  baen  shown  that  a  rastricted  version  of  the 
constrained  wake  search  problem  is  in  NP.  It  can  be  hypoth¬ 
esized  that  if  the  restriction  (that  r  and  II  be  polynomial 


functions  of  N)  wars  removed  the  problem  would  not  be  in  NP. 
It  has  also  been  shown  that  the  unconstrained  wake  search 
problem  is  functionally  similar  to  a  problem  which  has  been 
previously  determined  to  be  NP-complete.  Therefore,  it  seems 
reasonable  to  conjecture  that  the  constrained  wake  search 
problem  is  at  least  NP-complete  and  possibly  NP-Hard.  The 
consequences  of  this  conjecture  are  that  +-he  problem  is 
fundamentally  intractable  and  thera  do  not  exist  'efficient* 
algorithms  for  solving  the  problem.  Thus  any  heuristic  algo¬ 
rithms  such  as  those  presented  in  this  thesis  are  appro¬ 
priate  methods  for  attempting  to  find  optimal 
near-optimal  solutions. 
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GRAPHICAL  COBPARISOI  OP  AL50RITHB  RUNTIMES 


This  appendix  contains  graphs  of  the  runtimes  of  th 
algorithis  foe  the  following  cases: 

1.  4  cell  grid,  T1*0,  and  Taax*1,1D 

2.  4  cell  grid,  Tl*1 ,  and  Tmax=1,13 

3.  4  cell  grid,  Tl=2,  and  Tmax*1,1Q 

4.  9  cell  grid,  T1*0,  and  Tmax*1,10 

5.  9  cell  grid,  Tl=1,  and  Tmax=1,10 

6.  9  cell  grid,  Tl*2  ,  and  Taax=1,13 


7. 

16 

cell 

grid. 

T1*0, 

and 

Taax*1 ,10 

8. 

16 

cell 

grid. 

Tl*  1 , 

and 

Tmax*1 ,10 

9. 

9) 

16  c 

ell  gr 

id,  Tl* 

2, 

and  T«ax*1 

10. 

25 

cell 

grid. 

Tl*0, 

and 

Tmax* 1,10 

11. 

25 

call 

grid. 

Tl*  1, 

and 

Taax*1 , 1 0 

12. 

25 

cell 

grid. 

Tl*2, 

and 

Tmax*1 ,10 

Each  graph  contains  the  runtimes  for  each  of  the  seven  algo 
rivhas,  with  the  following  syabols  representing  each  algo 
ritha : 

•  -  Depth-First  strategy,  myopic  starting  solution 

*  -  Depth-First  strategy,  random  starting  solution 

♦  -  Depth-First  strategy,  restart  algorithm 

x  -  Best-Pirst  Strategy,  myopic  starting  solution 

V  -  Best-Pirst  strategy,  random  starting  solution 

A  -  Best-First  strategy,  restart  algorithm 

o  -  Total  Ena  aeration 
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Figura  B.9  16  Call  Grid,  Tl*2,  and  Taa**1,10 
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PigtireB.11  25  Cell  Grid,  ri*1,  and  r«ax*1,lO. 
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